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Summary 

Insect  visual  systems  are  extremely  compact  and  presumably  optimized  for  optimal 
processing  of  optical  information.  Unravelling  the  pathways  of  spatial,  spectral  and 
polarization  vision  combined  in  insect  eyes  and  brains  will  provide  essential  insight  into 
optimization  principles  of  how  animals  derive  crucial  information  for  survival.  In  insect 
compound  eyes,  the  distribution  of  optical  axes  determines  the  spatial  sampling  of  the 
optical  information  in  the  surrounding  environment.  To  map  the  visual  fields  of  the 
compound  eyes,  a  motorized  goniometric  apparatus  has  been  developed  allowing  the 
measurement  of  the  visual  axes  of  the  sampling  units,  the  ommatidia.  With  a  semi- 
automated  measurement  procedure,  which  uses  the  prominent  pseudopupil  phenomenon, 
spatial  maps  can  be  determined.  The  acquired  data  forms  the  basis  for  analyses  of  optic 
flow  and  optimization  of  spatial  vision  depending  on  speed  of  flight.  The  simultaneously 
acquired  data,  allowing  assessment  of  ocular  heterogeneity,  i.e.  the  dependence  of 
spectral  properties  on  spatial  directions,  reveals  how  spatial  vision  may  compete  with 
spectral  and  polarization  vision. 

Introduction 

The  visual  systems  of  animals  sample  the  light  properties  of  the  surrounding  world  with 
photoreceptor  cells.  The  spatial  distribution  of  the  sampling  points,  given  by  the 
distribution  of  the  photoreceptors’  visual  axes,  appears  to  be  strongly  species-dependent, 
which  appears  to  be  intimately  related  to  the  animal’s  behavior  and  its  habitat.  Insects 
have  been  recognized  to  be  ideal  model  systems  for  investigating  the  spatial 
characteristics  of  the  visual  system  because  of  the  enormous  variety  of  insect  life  styles, 
habitat,  and  body  sizes.  Predatory  insects  (dragonflies,  robberflies)  -  like  predatory 
higher  animals  (hawks,  falcons,  lions)  -  have  distinct  foveas,  i.e.,  areas  with  a  high 
density  of  spatial  sampling  points,  which  are  combined  with  peripheral  areas  where 
spatial  resolution  is  coarse.  The  spatial  acuity  of  non-predatory  animals  (butterflies, 
rabbits)  is  more  evenly  distributed,  but  commonly  males  have  an  eye  area  with  higher 
spatial  acuity,  devoted  to  mate  finding.  Spatial  eye  maps  have  been  partially  charted  in  a 
few  scattered  insect  cases,  but  the  crucial  factors  shaping  the  eyes  and  their  spatial 
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sampling  are  poorly  known.  The  aim  of  this  program  was  to  address  fundamental  issues 
regarding  multisensory  contributions  to  guidance,  navigation  and  flight  control  (GNC)  in 
a  variety  of  insect  species. 

Differences  in  local  spatial  acuity  of  insect  eyes  reflect  a  functional 
regionalization  that  serves  different  tasks  concerning  inner-loop  control  of  gaze  and  flight 
(low  spatial  resolution  =>  optic  flow  processing)  and  outer-loop,  or  goal-directed 
behavior  (high  spatial  resolution  =>  prey/mate  detection).  Evidently,  the  way  visual  axes 
are  organized/packed  in  a  compound  eye  reflects  the  different  visual  tasks  an  insect  has  to 
accomplish  and  the  relative  weight  it  assigns  to  them.  Different  regions  of  the  eye  feed 
visual  information  into  pathways  specialized  for  high  acuity  image  segmentation  or 
motion  vision,  color  vision  or  polarization  detection,  which  may  cooperate  with  other 
modalities  such  as  mechanosensory  and  olfactory  systems.  Quantitative  knowledge  of  the 
spatial  organization  of  the  eyes  of  various  insect  species,  specialized  in  a  predatory 
lifestyle  or  being  peaceful  visitors  of  colored  flowers,  will  create  insight  into  the 
optimization  principles  of  visual  image  processing. 

The  visual  system  performs  multiple  tasks.  In  addition  to  motion  and  pattern 
detection,  spectral  discrimination  and  color  vision  are  prominent  facilities  utilized  by 
insects  to  detect  conspecifics  for  mating,  and  therefore  body  coloration  can  be  used  for 
display.  Interspecific  recognition  is  complemented  by  the  detection  of  species-dependent 
flight-behavior  patterns.  Alternatively,  body  patterning  and  coloration  can  be  optimized 
for  camouflage.  As  the  eye,  consisting  of  the  dioptrical  apparatus  and  the  retinal  layer 
with  photoreceptors,  is  the  input  channel  of  the  visual  system,  detailed  knowledge  of  the 
primary  processing  station  and  its  relation  of  the  insect’s  optical  environment  is  essential 
for  proper  analysis  of  the  working  of  the  neural  system  and  of  how  it  mediates  successful 
survival. 

Results 

In  the  previous  program  supported  by  the  EOARD/AFOSR,  ‘Photonic  crystals  on  the 
wing’  [FA8655-08-1-3012],  the  research  emphasis  has  been  on  the  optical  coloration 
mechanisms  applied  by  insects.  During  this  highly  successful  program  such  a  large 
volume  of  research  data  had  been  accumulated,  that  its  condensation  in  scientific 
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publications  has  taken  a  protracted  time  span,  much  after  the  official  completion  of  the 
research  project.  The  decision  that  it  was  important  to  first  publish  the  new  insights  has 
so  far  prevented  a  fulltime  devotion  to  the  ‘eye  mapping’  project.  Yet,  this  was 
considered  to  be  unavoidable  and  necessary,  because  the  research  on  coloration  photonics 
has  close  links  with  the  planned  vision  research  studies. 


Fig.  1.  The  eye  charting  setup.  A  Front  view,  showing  the  motorized  goniometer  with  an 
epi-illumination  microscope  and  camera,  the  motor  driver  and  PC.  B  Rear  view,  showing 
the  motorized  XYZ-stage  with  the  insect  holder.  C  Side  view  showing  the  belt-driven 
horizontal  rotator  of  the  goniometer  and  the  the  motorized  XYZ-stage. 
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Fig.  2.  Images  of  the  eye  of  a  cabbage  butterfly  and  processing  of  the  eyeshine.  A  Image 
at  the  corneal  level  and  analysis  of  ommatidial  reflections.  B  Image  I  mm  above  the 
cornea  and  analysis  of  ommatidial  reflections  (scale  bar:  100  pm). 


The  present  state  of  the  eye  charting  setup  is  a  motorized  goniometer  around  a 
holder  with  the  investigated  insect  on  a  motorized  XYZ-stage  (Fig.  1).  From  pseudopupil 
images  the  visual  direction  of  the  individual  ommatidia  are  calculated  with  matlab 
programs  (Fig.  2).  Automatization  of  the  analysis  procedure  has  not  been  realized  yet  to 
satisfaction  because  of  limited  workforce.  We  hope  to  reach  that  state  later  this  year. 

During  the  program  period  22  papers  have  been  produced,  which  are  listed  below. 
The  numbered  papers  can  be  divided  into  a  few  categories: 

A.  Butterfly  wing  coloration:  #  1,  2,  3,  6,  10,  18,  19,  20 

B.  Beetle  wing  colors:  #  4,  5,  8,  13 

C.  Damselfly  colors:  #7,  12,  20 

D.  Insect  photoreceptors:  #9,  1 1 

E.  Bird  vision  and  colors:  #  15,  16,  20,  21 

F.  Flower  colors  and  insect  vision:  #  17,  22 
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A.  Butterfly  wing  coloration 

The  wings  of  butterflies  are  studded  with  small  scales  (size  -150x50x2  gm^).  The  scales 
are  generally  colored  due  to  pigmentation,  but  very  often  they  have  photonic  structures 
that  cause  structural  coloration.  We  discovered  in  the  Asian  butterfly  Graphium  sarpedon 
a  unique  scale  type  that  very  approximately  acts  as  an  ideal  thin  film.  Oblique 
illumination  results  in  highly  polarized  reflections,  which  presumably  mediate 
interspecific  recognition,  because  butterflies  possess  polarization  vision,  in  addition  to 
spatial  and  spectral  (color)  vision  (#1). 


Fig.  3.  White  and  glass  scales  on  the  wing  under  side  of  G.  sarpedon.  (A)  Light 
microscopical  section  of  a  wing  patch  with  a  few  white  scales.  (B)  A  wing  patch  with  a 
few  glass  scales.  (C)  Transmission  electron  microscopical  (TEM)  section  of  a  white 
scale.  (D)  TEM  section  of  a  glass  scale  (note  that  the  flat,  lower  lamina  faces  the  wing 
underside  in  both  C  and  D).  (E)  Scanning  electron  micrograph  (SEM)  of  a  white  scale. 
(F)  SEM  of  a  glass  scale.  Bars:  20  pm  (A,  B),  1  pm  (C,  D),  1  pm  (E,  F). 


Highly  sophisticated  structural  coloration  is  realized  in  certain  papilionid 
butterflies,  specifically  Parides  sesostris.  The  gyroid  structures  in  the  wing  scales  reflect 
broad-band  blue-green  light.  Interestingly,  the  structural  coloration  is  tuned  to  green  by 
blue-absorbing  pigment  so  to  enhance  camouflage  when  the  butterfly  rests  on  leaves  (#3). 
A  similar  tuning  to  a  green  color  occurs  in  papilionids  belonging  to  the  nireus  group,  but 
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here  the  structural  coloration  is  caused  by  highly  reflective  multilayer  structures  (#2,  6). 
A  very  different  method  to  improve  camouflage  is  practiced  by  the  Japanese  angled 
sunbeam  butterfly,  Curetis  acuta.  Its  wing  scales  have  a  bright  silvery  color,  which  takes 
the  color  of  surrounding  leaves  when  the  butterfly  is  at  rest  (#10). 

Recently  we  discovered  that  pigmentary  tuning  of  photonic  coloration  mechanism 
is  almost  universal  in  butterfly  wings.  Most  butterfly  wing  scales  are  rather  simply 
structured,  with  a  very  thin  lower  lamina  and  an  upper  lamina  consisting  of  ridges 
connected  by  crossribs.  The  color  of  these  scales  has  so  far  been  generally  attributed  to 
the  scale’s  pigmentation.  Recently  we  discovered  that  the  principal  coloration  tool  is  the 
lower  lamina,  acting  as  an  optical  thin  film  (#18-20).  The  reflectance  band  of  the  thin 
film  is  intimately  linked  to  the  absorbance  spectrum  of  the  pigment  (if  present).  The 
universal  function  of  pigments  in  butterfly  scales  thus  is  to  fine  tune  the  scale’s  structural 
reflectance  spectrum. 

B.  Beetle  wing  colors 

Whereas  most  insect  wings  are  rather  thin  and  flexible  chitinous  structures,  in  beetles  this 
holds  for  only  one  wing  pair;  the  other  two  wings  are  thick  and  solid  curved  plates  that 
serve  as  reliable  body  covers  for  sessile  or  walking  beetles.  In  many  beetle  species  these 
so-called  elytra  are  extremely  reflective,  and  their  optical  properties  have  intrigued 
numerous  scientists,  including  Newton,  Goethe,  Raleigh,  and  Michelson.  Our  recent 
studies  have  clarified  various  optical  mechanisms  applied  by  beetles.  The  jewel  beetles 
(Buprestidae)  have  elytra  with  melanin  layers  that  act  as  multilayer  reflectors,  causing 
brilliant  green  or  red  metallic  reflections  (#13).  The  Brazilian  Diamond  Beetle,  Entimus 
imperialis,  however,  has  elytra  indented  by  concave  pits  with  structural-colored  scales, 
consisting  of  domains  of  three-dimensional  photonic  crystals  that  have  a  diamond-type 
structure.  The  domains  are  very  large  and  thus  allowed  for  the  first  time  to  explore  the 
visible-light  optical  properties  of  diamond-type  photonic  crystals  (#4)  Curiously  enough, 
the  sophisticated  optics  is  used  to  realize  camouflaging.  Applying  additive  coloration,  the 
summated  reflections  of  variously  colored  domains  causes  an  overall  green  color  (#5,  8). 
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Fig.  4.  The  Diamond  Weevil,  Entimus  imperialis,  and  its  scale  organization.  A  The  intact 
animal  with  the  black  elytra  studded  with  numerous  yellow-green  pits  (bar:  1  cm).  B  A 
single  pit  as  seen  in  an  epi-illumination  polarization  microscope  with  polarizer  and 
analyzer  parallel  (bar:  0.5  mm).  C  A  single  scale  with  a  few  differently  colored  domains. 
Note  the  different  lamellar  arrangements  in  the  yellow  and  cyan  part  (white  arrowheads, 
bar:  50  pm).  D  A  domain  border  showing  the  difference  in  lamellar  arrangements  (bar:  5 
pm). 


C.  Damselfly  colors 

Male  broad-winged  damselflies  (or  demoiselles,  Calopterygidae)  have  wing  veins  with 
melanin  layers  that  create  intense  blue  wing  colors  (#7).  The  coloration  could  be 
quantitatively  explained  using  refractive  index  data  obtained  with  a  newly  developed 
polarization-interference  method  based  on  Jamin-Lebedeff  microscopy  (#12).  Most 
dragonflies  and  damselflies  have  transparent  wings,  which  are  however  so  thin  (<  1  pm) 
that  interference  colors  arise,  which  can  be  understood  with  thin  film  optics  (#20). 
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Fig.  5.  The  American  Rubyspot,  Hetaerina  americana.  A  Photograph  of  the  resting 
damselfly,  showing  the  prominently  red  pigmented  wings.  B  A  single  wing,  with  the 
meshwork  of  veins  (bar:  5  mm).  C  A  small  section  of  the  red-pigmented  wing  part, 
showing  that  veins  as  well  as  the  membrane  in  between  are  pigmented  (bar:  0.1  mm).  D 
Real  part  of  the  refractive  index  of  the  wing  membrane  as  a  function  of  wavelength  for 
the  red,  pigmented  and  the  clear,  unpigmented  wing  membrane  (blue  symbols).  The  black 
line  is  the  dispersion  curve  for  insect  chitin. 


D.  Insect  photoreceptors 

Insect  vision  starts  with  the  absorption  of  light  by  the  visual  pigment  (rhodopsin) 
molecules  located  in  the  membrane  of  the  visual  photoreceptor  cells.  The  rhodop sin-filled 
membrane  is  folded  into  an  optical  wave-guiding,  cylindrical  structure.  Previous  work 
has  explained  in  great  detail  the  integrated  optical  system  of  facet  lenses  and  optical 
waveguide.  Yet,  pigment  granules  accumulated  near  the  waveguide  boundary  affects  the 
light  flux  in  the  waveguides,  thus  acting  as  a  colored  pupil  mechanism,  which  not  only 
reduces  the  intensity  of  the  light  flux  but  also  its  spectral  content.  The  effective  spectral 
sensitivity  of  the  visual  photoreceptors  hence  can  be  greatly  modified.  This  is  especially 
the  case  for  photoreceptors  of  pierid  butterflies.  Together  with  Japanese  colleagues,  we 
have  analyzed  the  spectral  sensitivities  of  the  photoreceptors  of  both  male  and  female 
Eastern  pale  clouded  yellow  butterflies,  Colias  crate.  Males  and  females  appear  to  have 
different  sets  of  spectral  photoreceptors,  and  therefore  their  eyes  presumably  have 
different  color  discrimination  properties  (#9). 
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Fig.  6.  The  owlfly  Libelloides  macaronius.  A  Photograph  of  the  owlfly  in  a  typical 
resting  position,  ready  to  start  a  flight  searching  for  insect  prey.  B  Scanning  electron 
micrograph  of  the  right  compound  eye,  showing  the  clear  sulcus,  dividing  the 
dorsofrontal  (DF)  from  the  ventrolateral  (VL)  part.  C  An  anatomical  section  of  the  eye, 
showing  its  superposition  structure.  B  The  wavelength  dependence  of  the  contrast 
between  clouds  and  sky,  indicating  the  advantage  for  the  owlfly  to  have  virtually 
exclusively  UV  sensitive  eyes. 

In  another  collaborative  study,  we  have  analysed  the  visual  properties  of  the 
owlfly  Libelloides  macaronius,  which  has  highly  spatially  acute  vision  due  to  strongly 
contrast-sensitive  photoreceptors  (#1 1). 
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E.  Bird  vision  and  colors 

Our  studies  on  spectral  filtering  of  insect  photoreceptors  initiated  a  comparative  study  on 
bird  eyes,  where  carotenoid-filled  oil  droplets  are  positioned  in  front  of  the  bird  cone-type 
photoreceptors.  The  oil  droplets  appear  to  act  as  spectral/color  filters,  but  moreover  are 
powerful  microlenses.  Kramers-Kronig  modeling  showed  that  their  power  depends  on  the 
carotenoid  concentration,  and  FDTD  (finite-difference  time-domain)  modeling 
demonstrated  the  effective  focusing  of  incident  light  into  the  photoreceptor  cones  (#15). 


wavelengih  (nm) 

Fig.  7.  Oil  droplets  of  bird  photoreceptors.  A  The  diagram  shows  a  schematic  bird  eye 
with  the  four  single  cone  classes  with  their  oil  droplet  types  (T,  transparent;  C,  clear  (or 
colorless);  Y,  yellow;  R,  red),  and  the  double  cones  with  P  (pale)  droplets.  Inset:  Section 
of  the  retina  of  an  ostrich  (Struthio  camelus);  scale  bar  10  pm.  B  Absorption  coefficients 
of  four  carotenoids  demonstrated  in  bird  oil  droplets,  normalized  to  1  pm‘^  C  The 
corresponding  contribution  to  the  refractive  index  of  the  oil  droplets. 

10 


Distribution  A:  Approved  for  pubiic  reiease;  distribution  is  uniimited. 


FDTD  modeling  also  allowed  quantitative  explanation  of  the  optics  of  the  spectacularly- 
colored  breast  feathers  of  the  bird  of  paradise  Lawes’  parotia.  The  boomerang-shaped 
barbules  of  these  feathers  contain  melanin  multilayers  enveloped  by  a  thin  film  (#16,  20). 
The  refractive  index  measurements,  essential  for  the  FDTD  calculations,  were  performed 
on  the  bird-of-paradise’s  silver-colored  occipital  feathers,  which  act  as  classical 
multilayers  (#21).  A  related  study  has  been  devoted  to  the  special  pigmentation  of 
amazon  parrots  as  well  as  their  structural  coloration  (14). 


Fig.  8.  FDTD  modelling  of  the  breast  feather  barbule  of  the  bird  of  paradise  Lawes’ 
parotia. 

F.  Flower  colors  and  insect  vision 

Insects  have  intimate  connections  with  flowers.  We  have  devoted  a  detailed  study  on  a 
recent  hypothesis,  widely  acclaimed,  that  bees  can  detect  flowers  by  their  iridescence. 
This  should  be  important  for  pollination.  A  crucial  tool  in  our  study  was  our  imaging 
scatterometer,  developed  5  years  ago.  We  may  emphasize  that  this  unique  instrument 
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could  not  have  been  built  without  the  ample  support  from  BOARD/ AFOSR.  The  claimed 
pollination  hypothesis  could  not  be  confirmed,  and  rather  it  appeared  that  the  theory  was 
unfounded,  i.e.  built  on  artificial  grounds  (#17).  The  continuation  of  this  work  has  been  a 
study  on  the  visitation  frequency  of  various  insect  species  on  flower  communities  (#21). 


Fig.  9.  Flowers  with  structured  petal  surfaces  and  scatterograms.  Column  1:  habitus 
pictures  of  the  flowers;  column  2:  scanning  electron  micrographs  of  the  flowers’  surface 
structure;  column  3:  scatterograms  of  the  surface  structure  of  flower  casts;  column  4: 
scatterograms  of  the  petals,  (a-d)  Ranunculus  ficaria.  (e-h)  Matricaria  chamomilla.  (i-1) 
Beilis  perennis.  (m-p)  Hibiscus  trionum.  Scale  bars:  (a,e,i,m)  1  cm,  (b,f,j,n)  20  pm.  The 
red  circles  in  the  scatterograms  indicate  angular  directions  of  5°,  30°,  60°  and  90°  (see 
Fig.  2).  The  black  bar  at  9  o’clock  is  due  to  the  sample  holder. 
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Expected  developments 

The  extensive  studies  on  the  optics  of  natural  coloration  and  the  interplay  of  coloration 
with  vision  has  resulted  in  a  comprehensive  description  of  the  main  coloration  principles 
underlying  animal  coloration.  We  will  temporarily  continue  this  research  program  but  the 
focus  is  rapidly  shifting  to  the  relationship  of  spectral,  spatial  and  polarization  vision. 
Most  importantly,  we  will  finalize  the  development  of  the  eye  charting  tool  in  the  near 
future.  We  expect  that  this  will  become  a  valuable  instrument  for  the  further  unravelling 
of  the  intricacies  of  insect  vision. 
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